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(57) Abstract 



A data storage system 
wherein a host computer is 
coupled to a bank of disk 
drives through a system 
interface. The interface 
includes a system memory 
comprising a pair of system 
memory sections. Each one of 
the system memory sections 
has a plurality of addressable 
locations for storing data 
written into such one of 
the memory sections at the 
addressable locations. A pair 
of system busses is provided, 
each one of the pair of system 
busses being coupled to a 
corresponding one of the pair 
of system memory sections. 
A plurality of directors is 
coupled to the system memory 
through the system bus. The 
directors arc configured to 
control data transfer between 
the host computer and the 
bank of disk drives as such 
data passes through the system 
memory. The directors are 
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configured to place the system in a dual-write mode, and in such mode, store therein a burst of the data to be transferred between the host 
computer and the bank of disk drives, transfer such stored burst of data sequentially to the pair of system busses, and enable both of the 
system memory sections coupled to such pair of system busses to have written therein, at the same one of the addressable locations, the 
same burst of data transferred sequentially to the pair of system busses. 
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DATA STORAGE SYSTEM 
Background of the Invention 
5 This invention relates generally to data storage 

systems, and more particularly to data storage systems 
having redundancy arrangements to protect against total 
system failure in the event of a failure in a component 
or subassembly of the storage system. 

10 As is known in the art, large mainframe computer 

systems require large capacity data storage systems. 
These large main frame computer systems generally 
includes data processors which perform many operations on 
data introduced to the computer system through 

15 peripherals including the data storage system. The 

results of these operations are output to peripherals, 
including the storage system. 

One type of data storage system is a magnetic disk 
storage system. Here a bank of disk drives and the main 

2 0 frame computer system are coupled together through an 
interface. The interface includes CPU, or "front end", 
controllers (or directors) and "back end 11 disk ^f. : - 
controllers (or directors) . The interface operates the 
controllers (or directors) in such a way that they are 

25 transparent to the computer. That is, data is stored in, 
and retrieved from, the bank of disk drives in such a way 
that the mainframe computer system merely thinks it is 
operating with one mainframe memory. One such system is 
described in U.S. Patent 5,206,939, entitled "System and 

30 Method for Disk Mapping and Data Retrieval", inventors 

Moshe Yanai, Natan Vishlitzky, Bruno Alterescu and Daniel 
Castel, issued April 27, 1993, and assigned to the same 
assignee as the present invention. 

As described in such U.S. Patent, the interface 

35 may also include, in addition to the CPU controllers (or 
directors) and disk controllers (or directors), 
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addressable cache memories. The cache memory is a 
semiconductor memory and is provided to rapidly store 
data from the main frame computer system before storage 
in the disk drives, and, on the other hand, store data 
5 from the disk drives prior to being sent to the main 
frame computer. The cache memory being a semiconductor 
memory, as distinguished from a magnetic memory as in the 
case of the disk drives, is much faster than the disk 
drives in reading and writing data. 
10 The CPU controllers, disk controllers and cache 

memory are interconnected through a backplane printed 
circuit board. More particularly, disk controllers are 
mounted on disk controller printed circuit boards. CPU 
controllers are mounted on CPU controller printed circuit 
15 boards. And, cache memories are mounted on cache memory 
printed circuit boards. The disk controller, CPU 
controller and cache memory printed circuit boards plug 
into the backplane printed circuit board. In order to 
provide data integrity in case of a failure in a 
20 controller, the backplane printed circuit board has a 

system bus made up of'a pair of buses. One set the disk 
controllers is connected to one bus and another set of 
the disk controllers is connected to the other bus. 
Likewise, one set the CPU controllers is connected to one 
25 bus and another set of the CPU controllers is connected 
to the other bus . The cache memories are connected to 
both buses.- Each one of the buses provides data, address 
and control information. 

Thus, the use of two buses provides a degree of 
30 redundancy to protect against a total system failure in 
the event that the controllers, or disk drives connected 
to one bus fail. Further, the use of two buses increases 
the data transfer bandwidth of the system compared to a 
system having a single bus. 
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Summary of the Tnvention 
In accordance with the present invention, a data 
storage system is provided wherein a host computer is 
coupled to a bank of disk drives through an interface. 
5 The interface includes a system memory comprising a pair 
of system memory sections. Each one of the memory 
sections has a plurality of addressable locations for 
storing data written into such one of the memory sections 
at the addressable locations. A system bus is coupled to 

10 the pair of system memory sections. A plurality of 
directors is coupled to the system memory through the 
system bus, such directors being configured to control 
data transfer between the host computer and the bank of 
disk drives as such data passes through the system 

15 memory. The directors are configured to place the system 
in a dual -write mode, and in such mode, store therein a 
burst of the data to be transferred between the host 
computer and the bank of disk drives, transfer such 
stored burst of data sequentially to the system bus, and 

2 0 enable both of the memory sections coupled to such system 

bus to have written trierein, at the same one of the 
addressable locations, the same burst of data transferred 
sequentially to the system bus. 

In accordance with another feature of the 
25 invention, the interface includes a system memory having 
a pair of system memory sections. Each one of the system 
memory sections has a plurality of addressable locations 
for storing data written into such one of the memory 
sections at the addressable locations. A system bus 

3 0 comprising a pair of system busses is provided, each one 

of the pair of system busses being coupled to a 
corresponding one of the pair of system memory sections. 
A plurality of directors is coupled to the system memory 
through the system bus. The directors are configured to 
35 control data transfer between the host computer and .the 
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bank of disk drives as such data passes through the 
system memory. The directors are configured to place the 
system in a dual -write mode, and in such mode, store 
therein a burst of the data to be transferred between the 
5 host computer and the bank of disk drives, transfer such 
stored burst of data sequentially to the pair of system 
busses, and enable both of the system memory sections 
coupled to such pair of system busses to have written 
therein, at the same one of the addressable locations, 

10 the same burst of data transferred sequentially to the 
pair of system busses. 

In accordance with another feature of the 
invention, during the dual -write mode, the directors 
store therein bursts of the data to be transferred 

15 between the host computer and the bank of disk drives . 
Each burst of data stored in the director is then 
transferred to one of the pair of system busses coupled 
to such director during one memory cycle and, during the 
next memory cycle, the same burst of data is then 

20 transferred again, but this time to the other one. of the 
pair system busses coupled to such director. Thus, the 
same stored burst of data is transferred sequentially to 
both the pair of system busses coupled to such director. 
The director sequentially enables both of the memory 

2 5 sections coupled to both such pair of system busses to 

have written therein, at the same addressable locations, 
the same data burst which had been sequentiality 
transferred to each of the pair of system busses coupled 
to the director. Thus, after the pair of system memory 

3 0 cycles, the burst of data and a copy of such burst of 

data are stored in the same addressable location of both 
memory sections. Consequently, redundant data bursts are 
stored in the system memory. 

In accordance with another feature ojUthe . 
35 invention, a dual-write bus is coupled to the plurality 

\ 
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of directors. Each one of the directors includes: (a) a 
director memory for storing the burst of data fed thereto 
from the either the host computer or the bank of disk 
drives; and, (b) a dual-write controller. The dual-write 
5 controller is adapted to: (i) provide a dual -write 

interrupt on the dual -write bus in response to a dual- 
write mode command fed to the system; (ii) receive a 
dual -write interrupt produced on the dual -write bus; and 
(iii) in response to the dual-write interrupt received on 
10 the dual -write bus, sequentially place the burst of data 
stored in the director memory on the pair of system 
busses for sequential storage in both of the system 
memory sections at the same one of the addressable 
locations . 

15 in accordance with still another feature of the 

invention, the system is adapted to return to a non-dual - 
write mode when each of the plurality of directors is 
reset to a non-dual -write mode in response to a reset 
condition provided to the system. When returned to the 

20 non-dual -write mode, each one of the directors is adapted 
to place the burst of data stored in the director memory 
on a selected one of the pair of system busses for 
storage of such stored data in the one of the system 
memory sections coupled to such selected one of the pair 

25 of system busses. 

In accordance with yet another feature of the. 
invention, each one of the directors is adapted to detect 
a fault in the transfer of the data between the director 
and each one of the pair of system memory sections. In 
30 response to a detected fault between the director and one 
of the pair of system memory sections, each one of the 
directors is adapted to force subsequent data transfers 
between the director and the other one of the pair of 
system memory sections. . „:-_r- 
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Brief Description of the Drawing 
These and other features of the invention will 
become more readily apparent from the following detailed 
description when read together with the accompanying 
5 drawings, in which: 

FIG. 1 is a data storage system adapted to operate 
in a dual -write mode or a non-dual write mode in 
accordance with the invention; 

FIG. 2 is a block diagram of an exemplary memory 
10 adapted for use in the system of FIG. 1; 

FIG. 3 is a block diagram of a rear-end director 
according to the invention, such director being adapted 
for use in the system of FIG. 1; 

FIG. 4 is a block diagram of a front -end director 
15 according to the invention, such director being adapted 
for use in the system of FIG. 1; 

FIG. 5 is a block diagram of a dual -write force 
HIGH/ LOW controller according to the invention and 
adapted for use in the front-end and rear-end directors 
20 of FIGS. 3 and 4; 

FIG. 6 is a flow diagram of a program stored in 
the directors of FIGS. 3 and 4, such program being 
adapted to place the system of FIG. 1 in a dual -write 
mode ; 

25 FIG. 7 is a flow diagram of a program stored in 

the directors of FIGS . 3 and 4 , such program being 
adapted to reset the system of FIG. 1 from the dual -write 
mode to a non-dual write mode; and 

FIG. 8 is a flow diagram of a program stored in 

30 the directors of FIGS. 3 and 4, such program being 
adapted to place the system of FIG. 1 in a forced 
HIGH/ LOW mode. 



V 
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Description of the Preferred Embo diments 
Referring now to FIG. 1, a data storage system 10 
is shown wherein a host computer 12 is coupled to a bank 
14 of disk drives through a system interface 16. The 
5 system interface 16 includes a system, or cache, memory 
18, having a high address memory sections 18H and low 
address memory sections 18L. A plurality of directors 
' 20 0 -20 15 is provided for controlling data transfer between 
the host computer 12 and the bank 14 of disk drives as 

10 such data passes through the system memory 18. The 

system 10 includes a system bus 17 comprising four system 
busses a top high address memory bus TH, a top low 
address memory bus TL, a bottom high address memory bus 
BH, and a bottom low address memory bus BL, described in 

15 more detail in co-pending patent application entitled 
"Data Storage System" , inventors Daniel Castle, et al . , 
filed on the same day as this application, assigned to 
the same assignee as the present invention, the entire 
subject mater thereof being incorporated herein by 

20 reference. More particularly, high address system busses 
TH, BH are electrically connected to the high address 
memory sections 18H. Low address system busses TL, BL 
are electrically connected to the low address memory 
sections 18L. Each one of the directors 20 0 -20 l5 is 

2 5 coupled to a pair of the system busses; one bus being a 

high address bus and the other being a low address bus . 
Thus, each one of the directors 20 0 -20 15 is coupled to the 
pair of the system memory sections 18H and 18L. 

Here, during a non-dual -write mode, the storage 

3 0 locations of the system memory 18 having the higher 

addresses are in the high address memory sections 18H and 
the storage locations having the lower addresses are in 
the low address memory sections 18L. It should be noted 
that each one of the directors 20 0 -20 l5 is eteet rical ly 
35 connected to one of the pair of high address system- 
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busses TH, BH and one of the pair of low address system 
busses TL, BL . Thus, each one of the directors 20 0 -20 15 
is able to address all locations in the entire system 
memory 18 (i.e., to both the high address memory sections 
5 18H and the low address memory sections 18L) and is 

therefore able to store data in and retrieve data from 
any storage location in the entire system memory 18. 
While the system busses BH, BL, TH, TL provide data, 
addresses and memory control (i.e., write enable, read 

10 enable) to the memory 18, the system 10 also includes a 
dual -write control signal bus DW which is connected to 
.all the directors, as indicated. 

More particularly, a rear-end portion of the 
directors, here directors 20 0 -20 3 and 20 12 -20 15/ is 

15 electrically connected to the bank 14 of disk drives 
through I/O adapter cards 22 0 -22 3 and 22 12 -22 l5 , 
respectively, and a front-end portion of the directors, 
here directors 20 4 -20 lx , is electrically connected to the 
host computer 12 through I/O adapter cards 22 4 -22 lx/ 

20 respectively. It should also be noted that each end of 
the busses TH, TL, BH, BL is terminated with a pair of 
master and slave arbiters, not shown, described in detail 
in connection with the above -referenced co-pending patent 
application . 

25 As will be described in detail hereinafter, the 

system 10 is adapted to operate in a number of modes. 
One mode is a non-dual -write mode, another mode- is a 
dual- write mode, and still another mode is a forced 
HIGH/LOW mode. First, it should be noted that data to be 

30 transferred between the host computer 12 and the bank of 
disk drives 14 is transferred as a series of bursts of 
such data. Further, it should be noted that the 
directors 20 0 -20 l5 store the bursts of the data being 
transferred between the host computer 12 and_the bank of 

35 disk drives 14. During a non-dual -write mode, the Stored 
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burst of data is transferred by the director storing such 
data to one of the two system busses coupled thereto for 
temporary storage in the system memory 18. However, in 
the dual -write mode, the burst of data stored in the 
5 director is transferred sequentially to both of the 
busses coupled to such director. The directors enable 
both of the memory sections 18H and 18L coupled to both 
such busses to have written therein, at the same one of 
the addressable locations, the burst of data transferred 
10 sequentially to the bus. Thus, two copies of the same 
burst of data is stored in the pair of memory sections 
18H, 18L for redundancy. 

Further, each one of the directors 20 0 -20 15 is 
adapted to detect a fault in the transfer of the data 
15 between the director and the memory sections 18H and 18L. 
In response to a detected fault between the director and 
one of the pair of memory sections 18H, 18L, each one of 
the directors is adapted to force subsequent data 
transfers between the director and the other one of the 
20 pair of memory sections. Thus, considering director 20 4 
which is coupled to buses BL and TH, if such director is 
to transfer a burst of data stored therein to memory 
section 18H via system bus TH and a fault in such 
transferred is detected as with Error Detection and 
25 Correction ( ED AC ) or "time-out" circuitry (not shown) in 
the memory section 18H or director 20 4 , such director 20 4 
the system 10 is placed by such director 20 4 in the forced 
HIGH/LOW mode, to be described. More particularly, in 
this example, the director 20 4 forces all transfers of 
3 0 bursts of the data to the other memory connected thereto, 
here memory section 18L via system bus BL until the fault 
is corrected. 
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Considering now the general operation of system, 
10, when the host computer 12 wishes to store data, the 
host computer 12 issues a write request to one of the 
front -end directors 20 4 -20 xl to perform a write command. 
5 One of the front-end directors 20 4 -20 ll replies to the 
request and asks the host computer 12 for the data. 
After the request has passed to the requesting one of the 
front-end directors 20 r 20 n , the director determines the 
size of the data and reserves space in the system memory 
10 18 to store the request. The front-end director then 
produces control signals to arbitrate for the given bus 
. on either a high address memory system bus (TH or BH) or 
a low address memory system bus (TL, BL) connected to 
such front -end director depending on the location in the 
15 system memory 18 allocated to store the data and enable 
the transfer to the system memory 18 . The host computer 
12 then transfers the data, as bursts of data, to the 
front -end director. The front -end director then advises 
the host computer 12 that the transfer is complete. The 
20 front -end director looks up in a Table, not shown, stored 
in the system memory 18 to determine which one of the 
rear-end directors 20 0 -20 3 and 20 12 -20 15 is to handle this 
request. The Table maps the host computer 12 address 
into an address in the bank 14 of disk drives. The 
25 front -end director then puts a notification in a "mail 
box" (not shown and stored in the system memory 18) for 
the rear-end director which is to handle the request, the 
amount of the data and the disk address for the data. 
Other rear-end directors poll the system memory 18 when 
30 they are idle to check their "mail boxes". If the polled 
"mail box" indicates a transfer is to be made, the rear- 
end director processes the request, addresses the disk 
drive in the bank, reads the data from the system memory 
18 and writes it into the addresses of a disk drive in 
3 5 the bank 14. When data is to be read from the bank s *14 of 
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disk drives to the host computer 12 the system 10 
operates in a reciprocal manner. 

As noted briefly above, the directors 20 0 -20 15 are 
configured to place the system 10 in a dual -write mode. 
5 In such dual-write mode, the directors 20 0 -20 l5 store 

therein bursts of the data to be transferred between the 
host computer 12 and the bank 14 of disk drives. Each 
burst of data stored in the director is then transferred 
to one of the pair of system busses coupled to such 
10 director during one memory cycle and, during the next 

memory cycle, the same burst of data is then transferred 
again, but this time to the other one of the pair of 
system busses coupled to such director. Thus, the same 
stored burst of data is transferred sequentially to both 
15 pairs of system busses coupled to such director. The 

director sequentially enables both of the memory sections 
18H and 18L coupled to both such pair of system busses to 
have written therein, at the same addressable locations, 
the same data burst which had been sequent iality 
2 0 transferred to each of the pair of system busses coupled 
to the director. For * example , considering director 2 0 4 , 
during the dual -write mode, a data burst from the host 
computer 12 passes to such director 20 4 and becomes stored 
in such director 20 4 . The stored data burst is then 
25 transferred to the system bus BL along with an address 
into which such data burst is to be written into memory 
section 18L, for example, during a system memory cycle. 
During the next system memory cycle, the same burst of 
data is transferred to system bus TH with the same 
30 addressable location used to for storage in memory 

sections 18L. Thus, during the second memory cycle, the 
same burst of data is stored in memory section 18H at the 
same addressable location as the burst of data was stored 
in memory section 18L. Thus, after the painxf system 
35 memory cycles, the burst of data and a copy of such *urst 
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of data are stored in the same addressable location of 
both memory sections 18H and 18L. Consequently, 
redundant data bursts are stored in the system memory 18. 

An exemplary one of the memory sections, 18H, 18L, 
5 here section 18H, is shown in FIG. 2 to include a 

plurality of here four DRAM sections coupled to top and 
bottom busses though bus interfaces and ASIC control 
logic, as indicated. 

Each one of the rear-end portion of the directors 

10 20 0 -20 3 and 20 12 -20 IS is identical in construction, an 

exemplary one therefor, here rear-end director 20 0 being 
shown in FIG. 3 to include a pair of central processing 
sections, CPU X and CPU Y, a dual port random access 
memory (RAM) section for storing the bursts of data and 

15 which includes a dual port RAM Y coupled to the Y CPU and 
a dual port RAM X coupled to the X CPU, shared resources 
(Flash memories, for, among other things, storage of 
programs the flow diagrams some of which are shown in 
FIGS. 6, 7 and 8, etc.), a pair of backplane interfaces 

20 22H, 22L, a pair of data latches 24H, 24L, a pair of 
address latches 26H, 26L, a pair of I/O backplane 
interfaces 28 x , 28 2 , and a dual -write force HIGH/LOW 
control section 30 (to be described in detail in 
connection with FIG. 5) all arranged as shown. The X and 

2 5 Y CPU sections are coupled to the bank 14 of disk drives 
(FIG. 1) through I/O adapter card 22 0 (FIG.l) via an I/O 
backplane section interface 28 w 28 2 , as indicated. It 
should be noted that the director has a primary output 
port, P, and a secondary output port, S. As described in 

30 detail in connection the above -referenced co-pending 
patent application, the primary port P is connected to 
both I/O backplane interface 28 x and I/O backplane 
interface 28 2 . Likewise, the secondary port S is 
connected to both I/O backplane interface 2 8 7 _and I/O 
35 backplane interface 2& l . 

\ 
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is 



The dual port RAM section of director 20, 
coupled to: (1) a high address memory bus, here BH, 
through data latch 24H and backplane section interface 
22H; and (2) a low address memory bus, here TL, through 
5 data latch 24L and backplane section interface 22L, as 
shown. Data (i.e., burst of data) are stored in the data 
latches 24H, 24L in response to latch signals fed thereto 
by the dual -write force HIGH/LOW control section 3 0 on 
lines 32H, 32L, respectively. As noted above, the dual- 
10 write/ force memory HIGH/ LOW control section 3 0 will be 
described in detail in connection with FIG. 5. Suffice 
it to say here, however, that such section 30 is adapted 
to: (i) provide a global dual -write interrupt (GLB_DW) on 
the dual -write bus DW in response to a dual -write mode 
15 command fed to the system. 10; (ii) receive a global dual- 
write interrupt (GLB_DW) produced on the dual -write bus 
DW by another one of the directors 20 1 -20 1S and (iii) in 
response to the global dual -write interrupt (GLB_DW) 
received on the dual-write bus DW, (either the GLB_DW it 
2 0 produced or the one produced by any one of the other 

directors) , sequentially place the data burst stored in 
the dual port RAM on both of the system busses BH, TL 
connected to such director at the same addressable 
location. Here, sequentially place the data burst stored 
25 in the dual port RAM on both of the system busses BH and 
TL at the same addressable location, as described above. 
It should be understood that when the system 10 is not 
provided a dual-write mode command (i.e., the system 10 
is in a non-dual -write mode) , the section 30 is 
30 configured to that the burst data in the dual port RAM is 
placed on either one of the two system busses, here 
either BH or TL, with different addressable locations. 
Further, if the system 10 is placed in a dual -write mode, 
such section 30 is adapted to return to a non^dual -write 
35 mode when each of the plurality of directors 20 0 -20 l5 >'is 



WO 00/39690 



PCT7US99/31178 



- 14 - 

reset, in response to a reset condition provided to the 
system 10, to a non-dual write mode. Still further, as 
noted above, each one of the directors 20 0 -20 ls is adapted 
to detect a fault in the transfer of the data between the 
5 director and the memory sections 18H and 18L. In 

response to a detected fault between the director and one 
of the memory sections 18H, 18L, each one of the 
directors is adapted to force subsequent data transfers 
between the director and the other one of the memories. 

10 Thus, considering director 20 4 which is coupled to buses 
TL and BH, if such director is to transfer a burst of 
data stored therein to memory section 18H via bus BH and 
a fault in such transferred is detected as with EDAC or 
11 time-out" circuitry, in the memory section 18H or 

15 director 2 0 4 , the system 10 is placed by such director 20 4 
in the force HIGH/LOW mode. More particularly, in this 
example, the director 20 4 forces all transfers of burst 
data to the other memory connected thereto, here memory 
section 18L via bus TL until the fault is corrected/ 1 

2 0 More particularly, in the dual -write mode, latch 

enable signals are. produced by the control section 3 0^ 
sequentially on lines 32H and 32L. That is, during one 
memory cycle, a latch enable signal is produced on, for 
example, line 32H and during the next memory cycle a 

25 latch enable signal is produced on line 32L in such 

example. In response to such latch enable signals, the 
burst of data in the dual port RAM is stored, in this 
example, sequentially into data latches 24H and-..24L, 
respectively. Further, in the dual -write mode, the latch 

30 signals on lines 32H, 32L latch a common address on 
either bus 34X or bus 34Y into address latches 26H or 
26L. The address latched into latches 26H and 26L 
provide the same address location in the system memory 18 
where such data burst is to be stored. It ig_noted that 

3 5 when the burst of data from the duai port RAM is latched 
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into data latch 24H and the address for such latched 
burst of data is latched into address latch 26H during 
one memory cycle by the latch enable signal on line 32H, 
such latched burst of data along with its address pass 
5 though the backplane interface 32H to the high address 
memory system bus BH, in this example. Likewise, in this 
example, during the next memory cycle, the same burst of 
data from the dual port RAM is latched into data latch 
24L and the address for such burst of data is latched 
10 into address latch 26L by the latch enable signal on line 
32L, such latched burst of data along with its address 
pass though the backplane interface 32L to the low 
address memory system bus TL, in this example. Thus, the 
burst of data being transferred from the dual port RAM 
15 for storage on the system memory 18 is here first placed 
on the bus BH, for example, via data latch 24H and 
backplane interface 22H during one memory cycle and then 
placed on bus TL via data latch 24L and backplane 
interface 22L during the next memory cycle. 
20 Each one of the front -end portion of the directors 

204-20^ is identical in construction and is substantially 
the same as the rear-end directors described above in 
connection with FIG. 3. Thus, an exemplary one thereof, 
here director 20, is shown in detail in FIG. 4 with 
25 equivalent elements being designated with the same 

numerical designation as that used in FIG. 3. Thus, the 
exemplary front -end director 20« is shown to include a 
pair of central processing sections (i.e., CPU X and CPU 
Y) , a dual port random access memory (RAM) section which 
3 0 includes a dual port RAM Y coupled to the Y CPU and a 
dual port RAM X coupled to the X CPU, shared resources 
(Flash memories, etc.), a pair of backplane interfaces 
22H, 22L, a pair of data latches 24H, 24L, a pair of 
address latches 26H, 26L, a pair of. I/O backplane 
35 interfaces 28,, 28 2 , and a dual-write force HIGH/LOW 
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control section 30 (to be described in detail in 
connection with FIG. 5), all arranged as shown. The X 
and Y CPU sections are coupled to the host computer 12 
(FIG. 1) through I/O adapter card 22 4 (FIG.l) via an I/O 
5 backplane section interface 28 r , 28 2/ as indicated. 

As with the rear-end directors, the dual port RAM 
section is coupled to: (1) a high address memory bus, 
here TH, through data latch 24H and backplane section 
interface 22H; and (2) a bottom low address memory bus, 

10 here BL, through data latch 24L and backplane section 

interface 22L, as shown. Data (i.e., burst of data) are 
stored in the data latches 24H, 24L in response to latch 
signals fed thereto by the dual -write force HIGH/LOW 
control section 30 on lines 32H, 32L, respectively. As 

15 noted above, section 30 is adapted to: (i) provide a 
global dual -write interrupt XGLB_DW) on the dual -write 
bus DW in response to a dual -write mode command fed to 
the system 10; (ii) receive a global dual-write interrupt 
(GLB_ DW) produced on the dual -write bus DW by another one 

20 of the directors 20 1 -20 1S and (iii) in response to the 
global dual -write interrupt (GLB_DW) received on the 
dual -write bus DW (either the GLB_DW it produced or the 
one produced by any one of the other directors) , 
sequentially place the data burst stored in the dual port 

2 5 RAM on both of the system busses connected to such 
director at the same addressable location. Here, 
sequentially place the data burst stored in the dual port 
RAM on both of the system busses TH and BL at the same 
addressable location. Further, if the system 10 is 

30 placed in a dual -write mode, such section 30 is adapted 
to return to a non-dual -write mode when each of the 
plurality of directors 20 0 -20 15 is reset, in response to a 
reset condition provided to the system 10, to a non-dual 
write mode. Still further, as noted above, _each one of 

35 the directors 20 0 -20 ls is adapted to' detect a fault in the 
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transfer of the data between the director and the memory 
sections 18H and 18L. In response to a detected fault 
between the director and one of the memory sections 18H, 
18L, each one of the directors is adapted to force 
5 subsequent data transfers between the director and the 
other one of the memory sections . 

Referring now to FIG. 5, the dual -write/Force 
HIGH/LOW control section 30 is shown to include: a pair 
of dual-write interrupt controllers 40 x/ 40 y coupled to 
10 the X CPU section and Y CPU section respectively of the 
director having such control section 30. Each one of the 
controllers 4 0 x/ 40 Y is identical in construction and is 
configured to: (i) provide a global dual-write interrupt 
YGLB_DW, XGLB_DW respectively in response to a dual -write 
15 mode command fed to the system 10 (FIG. 1) and (ii) 

receive a dual -write interrupt DW_INT produced on the 
dual -write bus DW either by the director having the 
control section 30 or any of the other directors. The 
XGLBJDW and YGLB_DW signals, here each being a two bit 
20 signal, are fed to an OR gate 42. The output of the OR 
gate 42 is a two bit signal GLB_DW_OUT which is fed to an 
GTL driver. The output of the GTL driver is the global 
dual-write signal GLB_DW and is fed to the other 
directors, via the dual write 'bus DW, and the director 
2 5 producing the GLB_DW signal via GTL receiver which 

produces the signal DW_INT for the pair of dual -write 
interrupt controllers 40 x , 40 Y . 

The dual -write/Force HIGH/LOW control section 30 
also includes a pair of address gate arrays 46 x and 46 v 
30 coupled to the X and Y interrupt controllers 40 x , 40 Y , 

respectively, as shown. The pair of address gate arrays 
46 x and 4 6 Y provide the system memory 18 addresses for the 
bursts of data stored in the dual port RAM/ During the 
dual-write mode, a common address for each ..bwst of data, 
35 as discussed above. The outputs of the address gate 
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arrays 56 x and 64 Y are fed to a logic section 50. The 
logic section 50 produces the latch signals on lines 32H, 
32L and the X and Y DRAM control signals (e.g. 
read/write/address) for the DRAM section. The 
5 controllers 40 x , 40 Y provide addresses for the burst of 
data being coupled from the dual port DRAM section (FIGS. 
3 and 4) to the data latches 24H, 24L on busses 34 x and 
34 y/ respectively. Thus, the addresses provided by the 
pair of address gate arrays 4 6 x and 46 Y on busses 34 x and 

10 34 Y are fed to the address latches 26H, 26L as shown in 
FIGS. 3 and 4, as discussed above. It is noted that the 
addresses on busses 34 x , 34 y is latched into the address 
latches 26H and 26L selectively in accordance with the 
latch signals on lines 32H and 32L. 

15 More particularly, during the dual -write mode, as 

noted above, the burst of data in the dual port RAM 
section is placed sequentially into data latches 24H and 
24L. It should be noted that during the dual -write jnode , 
when the burst of data is latched into data latch 24H, 

20 for example, an address for such data is latched into 
address latch 2 6H. Further, during the next system 
memory cycle when data is latched into latch 26L, the 
same address which had in the previous memory cycle had 
been latched into address latch 26H is latched into 

25 address latch 26L. During the non-dual -write mode, the 
address latched into the address latches 26H and 26L are 
independent from each other during successive memory 
cycles. 

Referring now to FIG. 6, a flow diagram of a 
30 program stored in the directors 20 0 -20 l5 is shown, such 
program being adapted to place the system 10 (FIG. 1) in 
the dual -write mode. Thus, at power-up (Step 600) the 
system 10 is checked to determine whether there is a 
balance in system memory 18 capacity between__the high 
3 5 address memory section 18H and the low address memory 
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section 18L (i.e, the sections have a memory capacity- 
balance). If there is an imbalance detected, (Step 602) 
the system 10 is powered-down by the user (Step 604) and 
additional memory capacity is added to a memory capacity 
5 deficient one of the sections 18L or 18H. 

After a balance in system memory 18 is detected, 
the users selects, if desired, a dual-write mode of 
operation. This mode is selected when the user wishes 
have redundant data in the system memory 18, i.e., the 

10 same burst of data in each of the memory sections 18L and 
18H. Thus, in the event of a failure in one of the 
memory sections 18H or 18L and data is not properly 
transferred between the host computer 12 or bank of disk 
drives 14 (FIG. 1) and such one of the memory sections, 

15 the same burst of transferred data is available in the 
other one of the memory sections 18H, 18L. In order for 
the system to operate properly in the dual -write mode, 
each of the directors 20 0 -20 15 must know that the system 
10 is being placed in the dual-write mode. Here, when 

20 any one of the directors 20 0 -20 15 detects that the user is 
placing the system, in "the dual -write mode, a signal is 
sent to both X and Y CPUs in such director (Step 606) . X--. 
In response to such signal, at a first subsequent system 
clock pulse the X and Y interrupt control sections 40 x and 

25 40 Y have a state machine register (not shown) change from 
an initial, reset, logic 0 state to a logic 1 on one of 
the two bits thereof. If such interrupt exists at the 
next system clock pulse, the state machine registers of 
both the X and Y interrupt control sections 40 x and 40 y 

30 have the second bit change from an initial logic 0 state 
to a logic 1 state. Thus, only if the dual -write request 
exists after the two system clock pulses will the state 
machine registers of both the X and Y interrupt control 
sections 40 x and 40 Y produce a binary 00 logi_Q- condi t ion 

3 5 on both busses XGLB_DW* and YGLB_DWV* respectively. A It 

\ 
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is noted the logic is here "active" low logic indicated 
in FIG. 5 by the asterisk (*) ) . Only when this logic 00 
condition is produced on busses XGLB_DW* and YGLB_DW* will 
the OR gate 42 produce a logic 00 condition on bus GLB_DW" 
5 (Steps 608, 610, 612), again in "active low" logic (Step 
606) . The logic 00 state on bus GLB_DW* is fed, via a GTL 
driver, to: the dual -write bus DW (FIG. 5) as a global 
dual-write signal, GLB_DW* ; and back to the X and Y 
interrupt control sections 40 x and 40 Y via a GTL receiver, 

10 as indicated in FIG. 5. The GLBJDW* signal indicates to 
this director, and all other directors, that a dual-write 
mode has been requested, i.e., a GLBJDW* signal has been 
asserted on the dual -write bus DW (Step 614, FIG. 6) . As 
noted above, the GLB_DW* , 11 logic signal, on the dual- 

15 write is fed to the interrupt issuing one of the 

directors 20 0 -20 1S and all other directors 20 0 -20 ls . Each 
one of the directors 20 0 -20 15 determines whether the state 
machine registers in the X and Y interrupt control 
sections 4 0 x and 40 v thereof is in the logic 00 condition. 

20 While the interrupt issuing one of the directors 20 0 -20 15 
has the state machine registers thereof in the 00 logic 
condition, the other one of the issuing one of the 
directors 20 0 -20 15 must wait two system clock pulses 
before the state machines thereof are placed in the logic 

25 00 condition (Step 613) . Once all the directors 20 o -20 15 
are in the dual -write mode, as indicated by software 
status (Step 615) the interrupt control sections 40 x and 
40 y send the global dual -write mode signal indication to 
the address gate array controllers 46 x , 46 Y (FIG. 5) (Step 

30 616) . 
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Referring now to FIG . 7, a flow diagram of a 
program stored in the directors 20 c -20 15 is shown, such 
program being adapted to reset the system 10 (FIG. 1) 
from the dual -write mode to a non-dual -write mode. In 
5 response to a user command to reset (i.e., disable) the 
dual -write mode, the software enters the "turn off" 
global dual-write routine (Step 700) . Interrupts are fed 
to the pair of Y and X interrupt controllers 40 x , 40 Y 
(FIG. 5, Step 702), and if after two system clock pulses 
10 the interrupt is proper (Step 704), the GLB_DW* signal on 
the dual-write bus DW is de-asserted (Step 706) . Because 
the dual -write control sections 30 are wire-ORd on the 
dual -write bus DW, it is necessary for all controllers 
20 0 -20 15 to have the GLB_DW* signal fed to the dual -write 
15 bus DW in a low, i.e., de-asserted logic state before all 
directors 20 0 -20 ls are placed in the reset) . That is, the 
dual -write mode is disabled and the system 10 is placed 
in the non-dual -write mode, Step 708. In response to the 
de-assert signal from the dual-write bus DW (i.e., all 
20 directors 20 0 -20 15 produce a dual -write mode de-assert 

signal on the dual -write bus DW) , the X and Y interrupt 
controllers 40 x , 40 y indicate to the address gate array 
controllers 46 x , 46 y that the system 10 is now in the non- 
dual-write mode (Step 710) . 
25 Referring now to FIG. 8, a flow diagram is shown 

of a program stored in the directors 20 0 -20 ls , such 
program being adapted to place the system 10 (FIG. 1) in 
a forced HIGH /LOW mode. Assume that the system 10 is 
operating normally in the dual-write mode (Step 800) . 
30 The controller measure the number of faults, or "time- 
out" errors reported to them (Step 802) . If none of the 
directors 20 0 -20 x5 is having reported to it errors or 
"time-outs" in less than a predetermined number, the 
system continues in the dual-write mode (Step r 804, 806) . 
35 On the other hand, if one of the directors 20 0 -20 ls i£ 
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having reported to it errors or "time-outs" in greater 
than the predetermined number, that director initiates 
the forced HIGH/LOW mode of operation for the system 10 
(Step 806). As discussed above in connection with FIGS. 
5 6 (Step 608) and 7 (Step 702), after the state machine 
registers of both the X and Y interrupt control sections 
40 x and 40 Y produce a binary 11 logic condition on busses 
either: (a) either busses XGLB_FOR_HI* and YGLBJErOR_HI\- 
or (b) either busses XGLB_FOR_LO and YGLB_FOR_LO\ 

10 respectively (Step 810) , depending on whether the faults 
are with transfers to the high address memory bus or the 
low address memory bus (Step 810) . (It is noted the 
logic is here "active" low logic indicated in FIG. 5 by 
the asterisk (*) ) . The signals on busses XGLB_FOR_HI* and 

15 YGLB_FOR_HI* are fed to NAND gate 60HI and the signals on 
busses XGLB_FOR_LO* and YGLB_FOR_LO* are fed to NAND gate 
60LO. If the logic signals on either busses XGLB_FOR_HI* 
and YGLB_FOR_HI* indicate a force HI bus condition (i.e., 
there are excessive faults or time-outs to the low 

2 0 address memory section 18L) . A GLB_FOR_HI* signal is 

produced (in '•active" 'low logic) for the director issuing 
such signal and for the other directors 20 p -20 ls . 
Likewise, if the logic signals on either busses 
XGLB_FOR_LO* and YGLB_FOR_LO* indicate a force LO bus 

25 condition (i.e., there are excessive faults or time-outs 
to the low address memory section 18H) , a GLB_F0R_HI * 
signal is produced (in "active" low logic) for the 
director issuing such signal and for the other directors 
20 0 -20 1S (Step 812) . It is noted that the NAND gates 60HI 

30 and 60LO are wire-ORd to the dual -write bus DW. It is 
also noted that the NAND gates 60HI and 60LO can have 
their outputs disabled via a user activated signal, 
DIS_IF\ which is fed to open collector drivers 61HI and 
61LO, as indicated. Thus, an interrupt is generated when 
35 any one of the directors 20 0 -20 l5 asserts a force hig+r/low 
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interrupt (i.e., either a GLB_FOR_LO* or GLB__FOR_HI * 
signal, FIG . 5 (Step 814) . The directors 20 0 -20 15 are now 
in the force HIGH/LOW mode (i.e., dual-write mode is 
disabled) and the X and Y interrupt controllers 40 x and 
5 40 Y indicate to the address gate array controllers 46 x and 
4 6 Y where the force HIGH and\or FORCE LOW condition is 
selected. The address gate array controllers 46 x and 46 Y 
then provide signals on the Y_TB_MEM" and X_TB_MEM' 
busses, respectively, to thereby enable the logic 50 to 

10 produce latch signals on lines 32H or 32L; the former 
being produced when in the force HIGH condition (i.e., 
excessive errors or time-outs to the low address memory 
section 18L) and the latter being produced when in the 
force LOW condition (i.e., excessive errors or time-outs 

15 to the high address memory section 18H) , Step 816, 

Other embodiments are within the spirit and scope 
of the appended claims . 

What is claimed is: 
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1. A data storage system wherein a host computer 
is coupled to a bank of disk drives through an interface, 
such interface comprising: 

a system memory comprising a pair of system 
5 memory sections, each one of the memory sections having a 
plurality of addressable locations for storing data 
written into such one of the memory sections at the 
addressable locations; 

a system bus coupled to the pair of .system 
10 memory sections ; 

a plurality of directors coupled to the 
system memory through the system bus, such directors 
being configured to control data transfer between the 
host computer and the bank of disk drives as such data 
15 passes through the system memory; and 

wherein such directors are configured to 
place the system in a dual -write mode, and in such mode, 
store therein data to be transferred between the host 
computer and the bank of disk drives, transfer such 
20 stored data sequentially to the system bus, and enable 

both of the memory sections coupled to such system bus to 
have written therein, at the same one of the addressable 
locations, the data transferred sequentially to the 
system bus. 

25 2. A data storage system wherein a host computer 

is coupled to a bank of disk drives through an interface, 

such interface comprising: 

(a) a system memory having a pair of system 

memory sections, each one of the system memory sections 
30 having a plurality of addressable locations for storing 

data written into such one of the memory sections at the 

addressable locations ; 



\ 



WO 00/39690 



PCT/US99/31178 



- 25 - 

(b) a pair of system busses each one of the 
system busses being in communication with a corresponding 
one of the pair of system memory sections; 

(c) a plurality of directors coupled to the 
5 system memory through the system busses, such directors 

being configured to control data transfer between the 
host computer and the bank of disk drives as such data 
passes through the system memory; and 

(d) wherein such directors are configured to 
10 place the system in a dual -write mode, and in such mode, 

store therein data to be transferred between the host 
computer and the bank of disk drives, and transfer such 
stored data sequentially to the pair of busses, and 
enable both of the system memory sections in 
15 communication with such system pair of busses to have 
written therein, at the same one of the addressable 
locations, the data transferred sequentially to the 
system busses for storage in both of "the memory sections. 

3. The system recited in claim 2 including a 

2 0 dual -write mode bus coupled to the plurality of 

directors, and wherein each one of the directors 
comprises : 

(a) a director memory for storing the data 
fed thereto from the host computer; and 
25 (b) a dual -write controller adapted to: 

(i) provide a dual -write interrupt on 
the dual -write bus in response to a dual -write mode 
command fed to the system; 

(ii) receive a dual-write interrupt 

3 0 produced on the dual -write bus; and 

(iii) in response to the dual -write 
interrupt received on the dual-write bus, sequentially 
place the data stored in the director memory^ the pair 
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of system busses for storage in both of the system memory 
sections at the same one of the addressable locations. 

4 . The system recited in claim 2 including a 
dual -write mode bus coupled to the plurality of 
5 directors, and wherein each one of che directors 
comprises : 

(a) a director memory for storing the data 
fed thereto from the host computer; and 

(b) a dual -write controller adapted to: 

10 (i) provide a dual-write interrupt on 

the dual -write bus in response to a dual -write mode 
command fed to the system; 

(ii) receive a dual -write interrupt 
produced on the dual -write bus; 

15 (iii) in response to the dual-write 

interrupt received on the dual-write bus, sequentially 
place the data stored in the director memory on the pair 
of system busses for storage in both of the system memory 
sections at the same one of the addressable locations. 

20 on at least one of the^system busses; and 

(iv) to return to a non-dual write mode 
when each of the plurality of directors is reset to a 
non-dual write condition in response to a reset condition 
provided to the system, and when in such non-dual write 

25 condition, place the data stored in the director memory 
on a selected one of the pair of system busses for 
storage of such stored data in the one of the system 
memory sections coupled to such selected one of the pair 
of system busses. 

30 5. The system recited in claim 3 wherein each one 

of the directors is adapted to detect a fault in the 
transfer of the data between the director and^each one of 
the system memory sections, and in response to a detected 



WO 00/39690 



PCT/US99/31178 



- 27 - 

fault between the director and one of the system memory 
sections, force subsequent data transfers between the 
director and the other one of the system memory sections. 

6 . A data storage system wherein a host computer 
5 is coupled to a bank of disk drives through an interface, 
such interface comprising: 

(a) system memory comprising a pair system 
memory sections, each one of the system memory sections 
having a plurality of addressable locations for storing 

10 data written into such one of the memory sections at the 
addressable locations ; 

(b) a pair of system busses each one of the 
system busses being in communication with a corresponding 
one of the pair of system memory sections; 

15 ( C ) a plurality of directors in communication 

with the system memory through the system busses, such 
directors being configured to control data transfer 
between the host computer and the bank of disk drives as 
such data passes through the system memory; and 

20 (d) wherein such directors are configured to- 

place the system in a forced system memory mode, and in 
such mode, store therein data to be transferred between 
the host computer and the bank of disk drives, and 
transfer such stored data only one of the system busses. 

25 7. The system recited in claim 6 including a 

dual -write mode bus coupled to the plurality of 
directors, and wherein each one of the directors 
comprises : 

(a) a director memory for storing the data 
3 0 fed thereto from the host computer; and 

(b) a dual -write controller adapted to: 
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(i) provide a dual -write interrupt on 
the dual-write bus in response to a dual-write mode 
command fed to the system; 

(ii) receive a dual -write interrupt 
5 produced on the dual -write bus; and 

(iii) in response to the dual -write 
interrupt received on the dual-write bus, sequentially 
place the data stored in the director memory on the pair 
of system busses for storage in both of the system memory 

10 sections at the same one of the addressable locations. 

8. The system recited in claim 6 including a 
dual -write bus coupled to the plurality of directors, and 
wherein each one of the directors comprises: 

(a) a director memory for storing the data 
15 fed thereto from the host computer; and 

(b) a dual-write controller adapted to: 

(i) provide a dual -write interrupt on 
the dual-write bus in response to a dual-write mode 
command fed to the system; 

20 .(ii)* receive a dual-write interrupt 

produced on the dual -write bus; 

(iii) in response to the dual -write 
interrupt received on the dual -write bus, sequentially 
place the data stored in the director memory on the pair 

2 5 of system busses for storage in both of the system memory 
sections at the same one of the addressable locations. 

9. A data storage system wherein a host computer 
is coupled to a bank of disk drives through an interface, 
such interface comprising: 
30 a system memory comprising a pair of system 

memory sections, each one of the memory sections having a 
plurality of addressable locations for storing data 

\ 
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written into such one of the memory sections at the 
addressable locations ,- 

a system bus coupled to the pair of system 

memory sections; 
5 a plurality of directors coupled to the 

system memory through the system bus, such directors 
being configured to control data transfer between the 
host computer and the bank of disk drives as such data 
passes through the system memory; and 

10 wherein such directors are configured to 

place the system in a dual -write mode, and in such mode, 
the directors store therein bursts of the data to be 
transferred between the host computer and the bank of 
disk drives, each burst of data stored in the director 

15 then being transferred to one of the pair of system 

busses coupled to such director during one memory cycle 
and, during the next memory cycle, the same burst of data 
being then transferred to the other one of the pair 
system busses coupled to such director, the same stored 

2 0 burst of data transferred sequentially to both the pair 
of system busses being* stored in both of the memory 
sections at the same addressable locations. 
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